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LISTENING DEVICE 

Field of the Invention 

The present invention generally relates to a listening device, and more 
particularly relates to a method for equalizing output signals from a plurality of 
signal paths processing a plurality of sound signals in a listening device, 
including hearing aids and headsets, speech recognition front-ends and hands- 
free telephony systems. 

Background of the Invention 

The background of the invention is described with particular reference to 
the field of directional hearing aid, where the present invention is applied, 
although not exclusively. 

Conventionally, hearing aids utilize two microphones spaced apart at a 
predetermined short distance in order to capture an incoming sound signal. 
Such devices are often referred to as a directional hearing aid since the 
subsequent processing of the two audio inputs results in a better directionality 
perception by the user of the hearing aid. Similar techniques are applied in a 
number of applications where there is spatial separation between the desired 
signal and noise sources. Examples include headsets, speech recognition 
systems and hands-free telephony in automobiles. 

In FIG. 1, there is shown a schematic representation of a prior art hearing 
aid, which is generally denoted by a reference numeral 10. As depicted in FIG. 
1 , the device includes two microphones 11a and 11b, two amplifiers 12a and 
12b, two analog-to-digital (A/D) converters 13a and 13b, a combiner 15, a digital 
signal processor (DSP) 16, a digital-to-analog (D/A) converter 17, and a loud 
speaker 18, which are successively connected. In operation, a sound signal 
coming from a surrounding environment, for example, from a person to whom a 
user of the device speaks, is captured by the microphone 1 1a, in which the 
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sound signal is converted to an electrical analog signal. The electrical analog 
signal is input to the amplifier 12a, where the analog signal is amplified to a 
higher specific level. Subsequently, the amplified analog signal is converted to a 
digital representation (a digital signal) of the sound signal in the A/D converter 

5 1 3a. Similarly, the other signal path, consisting of the microphone 11b, the 

amplifier 12b, and the A/D converter 13b, performs the same operation as above 
to produce another digital representation (digital signal) of the sound signal. The 
two digital signals are then processed in the combiner 15 where the two digital 
signals are combined into one single signal. The output signal of the combiner 

10 15 may be further processed in the DSP (digital signal processor) 16 where, for 
example, the signal is filtered or further amplified according to the specific 
requirements of the application. Alternatively, the combiner 15 can be 
incorporated into the DSP 16 such that the signal combining can be done in the 
DSP. 

15 Finally, the amplified and processed digital signal is converted back to an 

electrical analog signal in the digital-to-analog converter 17 and then converted 
into sound waves through the loud speaker 18, or applied directly to another 
systems as an electrical system from the output of the digital-to-analog 
converter 17. 

20 With the hearing aid noted above, however, use of matched microphones 

is required in order to perform a satisfactory directionality enhancement through 
combination and processing of the two audio signals. In this context, the 
matched microphones mean that they have equal transfer functions and thus 
equal magnitude and phase responses in a specified frequency range. The 

25 concept of matched microphones will be further described in greater detail in 
conjunction with the description of the preferred embodiments of the present 
invention. 



Currently, the provision of matched microphones has been attempted by 
using microphone pairs that have been matched by a microphone manufacturer. 



That is, the microphone manufacturer produces a number of microphones, 
followed by pairing of the microphones that have similar magnitude and phase 
response. The manual handling of the microphones affects their properties, and 
prevents automation of the manufacturing process. Also, additional costs are 
incurred in the attempt to match the microphones, though they are only matched 
within a specified tolerance. 

Also, US Patent Nos. 4,142,072 and 5,206,913 disclose microphone 
matching technologies. However, none of current methods are expected to be 
satisfactorily successful. 

Therefore, there is a need to solve the problems noted above and also a 
need for an innovative approach to replace the prior art. 

Summary of the Invention 

According to one aspect of the invention, there is provided a method for 
equalizing output signals from a plurality of signal paths in a listening device. 
The method comprises steps of: (a) identifying a transfer function for each of the 
signal paths, (b) determining a filtering function for each signal path such that a 
product of the transfer function and the filtering function is a selected function, 
and (c) applying the filtering function to the corresponding signal path, thereby 
correcting the transfer function of the signal path to the selected function to 
equalize the output signals from the signal paths. 

The selected function may be the transfer function for one of the plurality 
of signal paths. The filtering function may be set to a selected common factor. 

In one embodiment, the step of applying the filtering function comprises 
steps of: (a) providing a filter means to the signal path and (b) applying the 
filtering function to the filter means of its corresponding signal path, thereby 
equalizing output signals from the filter means of the signal paths. 

In another embodiment, the step of identifying a transfer function 



comprises steps of: (a) providing a sample signal to the signal path to produce a 
sample output signal through the signal path and (b) processing the sample 
signal and the sample output signal to identify the transfer function for its 
corresponding signal path. 

The signal path comprises (a) a microphone for converting a sound 
signal to an electrical analog signal; and (b) an analog-to-digital converter 
coupled to the microphone for converting the electrical analog signal into a 
digital signal, wherein the step of identifying a transfer function comprises steps 
of: (a) providing a noise sample to the microphone to produce a sample output 
signal through the signal path and (b) processing the noise sample and the 
sample output signal to identify the transfer function of its corresponding signal 
path. The transfer function of the signal path may be a transfer function of the 
microphone of each signal path. 

The step of identifying a transfer function comprises steps of: (a) 
acoustically providing a noise sample to the microphone with a propagation time 
delay to produce a first output processed through the signal path, (b) providing a 
second output corresponding to the noise sample with the propagation time 
delay, and (c) processing the first output and the second output to identify the 
transfer function of its corresponding signal path. The propagation delay time is 
selected to be integer multiple of the noise sample. 

The step of providing the noise sample comprises steps of: (a) providing a 
first digital noise signal, and (b) converting the first digital noise signal into the 
noise sample. The step of providing a second output comprises steps of: (a) 
providing a second digital noise signal, the second digital noise signal being 
synchronized with the first digital noise signal and having properties 
corresponding to the first digital noise signal, (b) delaying the second digital 
noise signal by same amount of time as the propagation delay time, and (c) 
compensating the conversion factor of the first digital noise signal into the noise 
sample. 
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The first and second digital noise signals are provided by a maximum 
length sequence generator. The first and second noise signals comprise a white 
noise signal or a random noise signal. 

According to another aspect of the invention, there is provided an 
apparatus for equalizing output signals from a plurality of signal paths in a 
listening device. The apparatus comprises: (a) means for identifying a transfer 
function for the signal path, (b) means for determining a filtering function for the 
signal path such that a product of the transfer function and the filtering function 
is a selected function, and (c) means for applying the filtering function to its 
corresponding signal path, thereby correcting the transfer function of the signal 
path to the selected function to equalize the output signals from the signal paths. 

The selected function may be the transfer function for one of the signal 
paths. The filtering function can be a common factor. 

In one embodiment, the filtering function applying means comprises: (a) a 
filter means provided to the signal path, and (b) means for applying the filtering 
function to the filter means of its corresponding signal path, thereby equalizing 
output signals from the filter means of the signal paths. 

In another embodiment, the transfer function identifying means 
comprises: (a) means for providing a sample signal to the signal path to produce 
20 a sample output signal through the signal path, and (b) means for processing 
the sample signal and the sample output signal to identify the transfer function 
for its corresponding signal path. 

The signal path comprises (a) a microphone for converting a sound signal 
to an electrical analog signal; and (b) an analog-to-digital converter coupled to 
25 the microphone for converting the electrical analog signal into a digital signal, 
wherein the transfer function identifying means comprises: (a) means for 
providing a noise sample to the microphone to produce a sample output signal 
through the signal path, and (b) means for processing the noise sample and the 




sample output signal to identify the transfer function of its corresponding signal 
path. The transfer function of the signal path may be a transfer function of the 
microphone. 

The transfer function identifying means comprises: (a) means for 
acoustically providing a noise sample to the microphone with a propagation time 
delay to produce a first output processed through the signal path, (b) means for 
providing a second output corresponding to the noise sample with the 
propagation time delay, and (c) means for processing the first output and the 
second output to identify the transfer function of its corresponding signal path. 
The propagation delay time is selected to be integer multiple of the first noise 
sample. 

The noise sample providing means comprises: (a) means for generating a 
first noise signal, and (b) means for converting the first digital noise signal into 
the noise sample. The second output providing means comprises: (a) means for 
generating a second digital noise signal, the second digital noise signal being 
synchronized with the first digital noise signal and having properties 
corresponding to the first digital noise signal; (b) means for delaying the second 
digital noise signal by same amount of time as the propagation delay time; and 
(c) means for compensating the conversion factor of the first digital noise signal 
into the noise sample. The converting means includes a digital-to-analog 
converter and in some applications, a loud speaker. 

The first and second digital noise signal providing means are a maximum 
length sequence generator. 

The first and second digital noise signals are a white noise signal or a 
random noise signal. 

The first and second digital noise signals can be provided by a single 
source. 



According to another aspect of the present invention, there is provided a 
method for correcting transfer functions of a plurality of signal paths. The 
method comprises steps of: (a) identifying a transfer function for each of the 
signal paths, (b) determining a filtering function for each signal path such that a 
product of the transfer function and the filtering function is a selected function, 
and (c) applying the filtering function to the corresponding signal path, thereby 
correcting the transfer function of the signal path to the selected function. 

Embodiments of the invention include a listening device including hearing 
aids and headset, speech recognition system front-ends and hands-free 
telephony front-ends, which utilizes the methods described above and/or 
comprises the apparatus described above. 

According to the present invention summarized above, the equalization 
process is carried out digitally so that absolute matching of the microphones can 
be accomplished. Therefore, the listening device user can get better speech 
intelligibility in noisy environments. Also, the equalization procedure of the 
invention is simply to deploy in production because the equalization is performed 
on the digital listening device chip by using a "one button" procedure. Thus, the 
work and expense to match microphones can be saved. 

A further understanding of the other features, aspects, and advantages of 
the present invention will be realized by reference to the following description, 
appended claims, and accompanying drawings. 

Brief Description of the Drawings 

Embodiments of the invention will now be described with reference to the 
accompanying drawings, in which: 

Figure 1 is a schematic representation of a prior art hearing aid; 

Figure 2a is a schematic representation of a hearing aid according to one 



embodiment of the invention; 

Figure 2b is a schematic representation of a headset according to 
another embodiment of the invention; 

Figure 2c is a schematic representation showing an embodiment of 
multiple signal paths according to the invention; and 

Figure 3 is a schematic illustration of the equalizing filter means in 
Figures 2 and 2a. 

Detailed Description of the Preferred Embodiment(s) 

The preferred embodiment will be described with particular reference to a 
hearing aid and a headset, to which the present invention is principally applied, 
but not exclusively. 

As one preferred embodiment of the present invention, a hearing aid 
using the inventive concept is schematically illustrated in FIG. 2a, where the 
hearing aid is generally denoted by a reference numeral 20. As depicted in FIG. 
2a, the hearing aid includes two microphones 21a and 21b, two amplifiers 22a 
and 22b, two analog-to-digital (A/D) converters 23a and 23b, two equalizing filter 
means 30a and 30b, a combiner 25, a digital signal processor (DSP) 26, a 
digital-to-analog (D/A) converter 27, and a loud speaker 28, which are 
successively connected. The configuration of the hearing aid is similar to the 
prior art shown in FIG. 1 , except for the equalizing filter means generally 
designated by reference numerals 30a and 30b, which constitute a significant 
concept and feature of the present embodiment of the invention and will be 
further described in greater detail hereinafter, particularly in conjunction with the 
description of FIG. 3. 

For the convenience of the description and explanation of the invention, 
the signal path consisting of the microphone 21a, the amplifier 22a and the A/D 
converter 23a is referred to as signal path A, and the signal path consisting of 



the microphone 21b, the amplifier 22b and the A/D converter 23b as signal path 
B. In this embodiment, two signal paths A and B are illustrated; however, more 
than two signal paths may be utilized, depending upon applications of the 
present invention. 

In general operation, sound signals from a surrounding environment are 
converted into electrical analog signals via the microphones 21a and 21b 
respectively. Each of the analog signals is then fed to the respective amplifier 
22a or 22b, where each signal is amplified to a specific level. The two amplified 
analog signals are converted through the respective analog-to-digital converter 
23a or 23b to digital signals, which correspond respectively to a digital 
representation for the input of two microphones 21a and 21b. Subsequently, 
these digital signals are equalized by passing through the respective equalizing 
filters means 30a or 30b, which are generally denoted by a reference numeral 
30. The equalizing means 30 and advantages associated with them will be 
further detailed below. 

The two digital signals are then processed in the combiner 25 where the 
two digital signals are combined into one single signal. This combination can be 
performed in various ways, i.e., by delaying one input signal before subtracting 
both input signals, or by applying more complicated directional processing 
methods. The output signal of the combiner 25 may be further processed in the 
DSP (digital signal processor) 26, where, for example, the signal is filtered or 
further amplified according to the specific requirements of the application of the 
invention, including the hearing loss of a user. Finally, the amplified and 
processed digital signal is converted back to an electrical analog signal in the 
digital-to-analog converter 27 and then converted into sound waves through the 
loud speaker 28. 

Alternatively, the DSP 26 can be replaced by an oversampled weighted- 
overlap add (WOLA) filterbank or a general purpose DSP core, which are 
described in US Patents Nos. 6,236,731 and 6,240,192 respectively. The 
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disclosures of the patents are incorporated herein by reference thereto. 

In order to facilitate the understanding of the present invention, the 
concept of a transfer function of a microphone or a signal path, matched and 
unmatched microphones, and the signal equalization will be described before 
disclosing the inventive concept of the equalizing filter means. A microphone 
converts an audio signal into an electrical signal. However, different 
microphones respond differently to the audio signal. 

Thus, the conversion from the audio domain to the electrical domain can 
be represented in terms of a transfer function or a filtering function. Together 
with the different magnitude response, a phase difference between the audio 
signal at the microphone inlet and the electrical output signal is also part of the 
transfer function due to the fact that the phase lag varies with the frequency. 

Within the microphone pass band, the attenuation and the time lags at 
the different frequencies are described in terms of a magnitude response and a 
phase response respectively of the microphone transfer function. As will be 
understood to those skilled in the art, the same idea will be applied to a signal 
circuit, for example, to the signal paths A and B as shown in FIG. 2a. In this 
embodiment of FIG. 2a, therefore, the transfer functions of the two microphones 
21a and 21b may be described as M1 and M2 respectively. Also, the magnitude 
term is described as mag(M1) and mag(M2) and the phase term as ph(M1) and 
ph(M2) respectively. Consequently, in the frequency region of interest, the 
criteria of matched microphones can be defined as: 

"A microphone 1 and a microphone 2 are said to be matched if M1 is 
equal to M2, i.e., mag(M1) is equal to mag(M2) and ph(M1) is equal to ph(M2)." 

In the prior art, they have been approximately matched. Thus, the above 
criteria of matched microphones could not be met in the prior art. 

The equalizing filter means 30a and 30b in FIG. 2a provide a solution to 
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the problems in the prior art noted above. Referring to FIG. 2a, the concept of 
the equalizing filter means is explained below. Firstly, the transfer functions (M1 
and M2) of the microphones 21a and 21b are identified, and secondly filtering 
functions (H1 and H2) are determined so that the overall transfer function 
between the inlet of the microphone and the output of the equalizing filter means 
can be equal to a certain selected function (F) for every individual microphone or 
signal path, which is generally represented by the following equation: 

M1 * H1 = F 
M2 * H2 = F 

M3*H3 = F (1) 
Mn* Hn = F, 

where n is the number of microphones or signal paths as illustrated in FIG. 2c. 

Therefore, each filtering function (H1, H2, H3, Hn) can be readily 

determined by dividing each equation with the transfer functions (M1 , M2, 

M3 ,Mn), which have been identified in the previous step. As will be 

understood by those skilled in the art, the transfer functions M1 and M2 may be 
identified for a signal path, for example, the signal paths A and B in FIG. 2a. 
Thus, in the embodiment of FIG. 2a, by applying the filtering function H1 and H2, 
the two output signals from the equalizing filter means are shaped in an identical 
way even though they might have been shaped differently by the two 
unmatched microphones 21 a and 21 b, or by the two signal paths A and B. 

Alternatively, the selected function (F) can be set up to a common factor 
A for the convenience of subsequent computations, which can be generally 
represented by the following equations: 

M1 * H1 = A 
M2 * H2 = A 

M3 * H3 = A (2) 
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Mn * Hn = A, 

where n is the number of microphones or the number of signal paths. Therefore, 

each filtering function (H1 , H2, H3 , Hn) can be readily determined according 

5 to the equation (1 ) or (2) by using the transfer functions (M1 , M2, M3 ,Mn), 

which have been identified in the previous step. 

FIG. 3 depicts an embodiment of the equalizing filter means in 
accordance with the present invention. For the convenience of the description, 
although one equalizing filter means 30a for the signal path A is illustrated in 

10 FIG. 3, the same configuration can be applied to every signal path. As noted 
above, the equalizing filter means of the invention, in general, comprises two 
major functional components, one is means for identifying a transfer function (M) 
of the signal path to which the corresponding equalizing filter means is coupled, 
and the other is means for determining a filtering function (H) so that a whole 

15 transfer function of the signal path after being processed by the equalizing 
means become a certain constant function. The transfer function (M) of the 
signal path can be a transfer function of a microphone in the respective signal 
path. 

As shown in FIG. 3, in this embodiment, the equalizing filter means 30a is 
20 coupled to the microphone 21a, the amplifier 22a, and the analog-to-digital 

converter 23a, which are from the signal path A in FIG. 2a. The equalizing filter 
means 30a comprises a first noise source 31, a second noise source 32, a 
synchronizer 33 for the first and second noise sources 31 and 32, a 
compensation filter 33, a delay block 34, and an identification block 35, a 
25 coefficient determination block 36, and an equalization filter 37. In FIG. 3, except 
for the coefficient determination block 36 and the equalization filter 37, all the 
elements which are bounded by a dot line C constitute the means for identifying 
a transfer function (M), which is one of two major functional components as 
noted above. The two remaining elements, the coefficient determination block 
30 36 and the equalization filter 37, are corresponding to the means for determining 
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a filtering function (H) depending upon the transfer function (M) identified by the 
previous means. 

The first and second noise sources 31 and 32 may include an MLS 
(Maximum Length Sequence) generator. The MLS generator is a noise 
generator which generates white noise or random noise in a controlled and 
predictable way; see T.Schneider, D.G. Jamieson, "A Dual channel MLS-Based 
Test System for Hearing-Aid Characterization", J. Audio Eng. Soc, Vol. 41, No. 
7/8, 1993 July/August, p583-593, the disclosure of which is incorporated herein 
by reference thereto. Ideally This MLS noise has an equal magnitude at all 
frequencies. Also, the fact that the noise can be generated in a controlled way 
means that the random noise is always the same on a sample-by-sample basis. 
Therefore, it is possible to have two or more noise generators, i.e., MLS 
generators, produce the exact same noise sample at different instants in time 
although the noise is said to be randomly distributed. In alternate, one common 
noise generator can be used for both the first and second noise sources 31 and 
32. 

All the elements in FIG. 3 work in combination to achieve the desired 
purpose of the equalizing means. That is, all the output signals from the 
equalization filter 30 remain constant for every signal path, so that they can have 
the same characteristics, for example, the same magnitude and phase response 
as if they were coming from a pair of ideally matched microphones. As illustrated 
in FIG. 3, the first noise source comprises a noise generator 31a for generating 
a first noise signal and a loud speaker 31b coupled to the noise generator 31a 
for converting the noise signal into the first noise sample. The loud speaker 31b 
has a known transfer function, and acoustically connected to the microphone 
21a with a propagation delay time (T), as noted by a dotted arrow D. Therefore, 
when the first noise samples from the loud speaker 31b travels to the 
microphone 21a, they are delayed by the delay time (T). The propagation delay 
time (T) is the time it takes for the first noise samples to propagate through air 
from the loud speaker 31b to the microphone 21a. Preferably, the delay time (T) 
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may be selected to be integer multiple of the first noise sample, so that 
subsequent computations can be simplified. Then, the first noise sample is 
successively converted into an electrical analog signal, an amplified signal, and 
a digital signal via the microphone 21a, the amplifier 22a, and the analog-to- 
digital converter respectively. Finally, the digital signal for the first noise sample, 
which represents an output in a digital form from the microphone 21a, is input to 
the identification method 35 as a first input signal. 

Referring to FIG. 3, the second noise source 32 produces a second noise 
signal as the second noise sample. The second noise signal is synchronized 
with the first noise signal by the synchronizer 33, and has the same signal 
properties as the first noise signal, so that two signals are identical at any instant 
in time. The second noise signal is compensated through the compensation filter 
33 for the conversion factor (i.e., the known transfer function of the loud speaker 
31 b) of the first noise signal by the loud speaker 31b, then, delayed by the same 
amount of time as the above propagation delay time (T) through the delay block 
34, and input to the identification block 35 as a second input signal. This second 
input signal can represent an input in a digital form to the microphone 21a since 
the amplifier 22a and the AID converter 23a have flat frequency responses in 
the frequency interval of interest. 

Subsequently, the two input signals are processed to identify an unknown 
transfer function (M) of the microphone 21 a by the identification block 35. In this 
embodiment, the transfer function can be estimated in terms of an Auto 
Regressive Moving Average (ARMA); see "Digital Signal Processing", Richard 
A. Roberts, Clifford T. Mullis, ISBN 0-201-16350-0, pg. 486-487, the disclosure 
of which is incorporated herein by reference thereto. That is, a mode, which 
contains both poles and zeroes, is of the form described in the following 
equation in case of z-domain: 
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M(z) = -=fc 0) 

In the above equation (3), the coefficients b and a can be estimated in 
various ways, for example, by using error minimization methods. In this 
embodiment, the Steiglitz McBride method may be used, but other method may 
also be applicable. The outcome of the identification block 35 is the coefficients 
b and a, which represent an estimate of the transfer function of the microphone 
21a. 

Once the transfer function M of the microphone or the signal path has 
been estimated as shown in the equation (3), the filter function H can be 
determined through the coefficient determination block 36, where a new set of 
coefficients for the filter function H are calculated according to the equations (1) 
or (2). The new coefficients are input to the equalization filter 37. 

As another preferred embodiment of the present invention, a headset 
using the inventive concept is schematically illustrated in FIG. 2b, where the 
headset is generally denoted by a reference numeral 20A. As depicted in FIG. 
2b, the headset further includes an adjustment filter 30c, in addition to all the 
components in the hearing aid illustrated in FIG. 2a. The operations of the 
components in FIG. 2b are identical to those in FIG. 2a, except for that of the 
adjustment filter 30c. 

In the adjustment filter 30c of the headset 20A, an equalized signal 
provided by the equalization filter 30b (i.e., from the signal path B) is further 
processed according to applications of the headset. That is, the phase from the 
signal path B can be precisely changed relative to the signal path A, such that 
subsequent combination of the two signals can result in optimal speech 
intelligibility from any directions rather than in front of the headset user as in the 
hearing aid. For example, this headset can be used by a driver in a car where 



the driver talks to a person on the back seat, or by a pilot in a plane where the 
pilot talks to a co-pilot next to him. 

It is noted that the equalizing filter means of Fig. 3 can be embodied as 
standalone equipment for determining equalizing coefficients and providing them 
to an equalization filter, thereby equalizing a plurality of signals from a plurality 
of signal paths. That is, the equipment comprises all elements of Fig. 3 except 
for the microphone 21a, the amplifier 22a, the A/D converter 23a, and the 
equalization filter 37. In operation of the equipment, for example, the hearing aid 
20 of Fig. 2a or the headset 20A of Fig. 2b can be provided with equalization 
filters F1 and F2 (like the equalization filter 37 in Fig. 3) instead of the whole 
filter means H1 and H2. Then, by using the standalone equipment, appropriate 
coefficients for each equalization filter F1 and F2 can be determined according 
to the same operation and procedures as noted above in conjunction with the 
previous embodiment of Fig.3, and stored in the hearing aid or the headset. 
Therefore, these coefficients are loaded into the filter when the hearing aid and 
headset are switched on by the end users. 

While the present invention has been described with reference to specific 
embodiments, the description is illustrative of the invention and is not to be 
construed as limiting the invention. Various modifications may occur to those 
skilled in the art without departing from the true spirit and scope of the invention 
as defined by the appended claims. For example, the present invention can 
apply to spatial processing as well. 



